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(54) nUir. TEMPLATE MATCHING METHOD AND DEVICE, AND RECORDING MEDIUM WHERE I'ROGRAM niFKE- 
FOR IS RECORDED 



e(u,v) 



AA 



BB 



Ii«(P) 
1{P;1)(P) 




A12 All P A21 A22 ^^f^^^i^^o) 



DO 



AA. . MATCHING EVALUATION VALUE 
BB... FIRST INTERPOLATION CURVE 
CO... SECOND INTERPOLATION CURVE 
DD... CANDIDATE IMAGE POSITION (u) 

^ (57) Abstrncl; A template matching method with low computational complexity and high detection accuracy. Compuiaiiun of the 
^ similarity between a template image area and a reference image area is carried out at space positional inlcr\als. The simihuity al 
IT) a position where no similarity is computed is estimated by interpolation from ihe similarities computed at around positions, thus 
reducing the degradation of the detection accuracy to a minimum level and simultaneously lowering Ihc compulation complexity. 
^5 In this case, estimates made by using the slope of the similarities independently determined in different directions. As a rcsuU. even 
ir the slope of the similarity changes, as shown in Figure 1, greatly at a local minimum point, the estimate has a high accuracy. A 
O threshold is determined on the basis of the similarity computed for the image obtained by shilling the templalL* image in ihc same 
or opposite direction as or u> the interpolation direction and ihe template image, and the difference beiween the u.Mimaied similarity 
and the similarity at an around position is limited so as not to exceed the thresh(»ld, thus preventing erroneous detection due to noise 
inclusion in the input image. 
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[0004] 1. h-v5/^>-i/^sfe<!;b-c, •^^y'^>^^mmtfj:^mmm^±oy^6^m 

ute Difference). '(a^-fit^^C025r!;CO¥^*Sj{i:(MSE:Mean Square Error) ^^^ri'^drfflV ^ 

(DWMykMf£.wmxwi^\ \i ^xmw^^^txm'^^m<:m.<M<Mn\^. 2m 0 urn 
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[0007] m2\'t^m^m^(D—m^B'tm^m-ch^o m^<Dnsmm^. -v-z-f-v^i^ 

2^BXit. m2[zi^^^x2xy-</u^nfc^mmikmi^(^mufM^d]:m^. %x\f^i 
isnmmm^tL-xm^-r^o 

[0008] CtD'grtJ-Cli, 15X15 = 225m(D^mmWL^i$l:^'^-^^y'f->^i^^tfj:-:>X\^^^M 

. ^mmnix^^y^>ymm^n^t225ja](DmB^iiW-yi^'j^^Mx:^^o zm.^. ^ 
u-r^z.t^^x^^o 

[0010] L;5>L/j:/i»5^. ^mmmmit. •^^yf'^^^^m&^<rTt>thi)mm^iw^x. mn 

•So. 
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[0012] wOj;9>'iP^t±if*. mu^<Dm^i^Mi!)^2^&<±w^u m^i\^^t^mummi 

: A Murat Tekalp, "Digital Video Processing." Prentice Hall !^R. 1995 
0¥fW[\SC^2:K, Tanaka, M. Sano, S. Ohara, M. Okudaira, "A parametric template 
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method and its application to robust matching, in Proc. of IEEE Conference on Co 
mputer Vision and Pattern Recognition, 2000. 

^#fT-:Sri)^3 : Masao Shimizu and Masatoshi Okutomi, "Significance and Atlribuies 
of Sub-Pixel Estimation on Area-Based Matching", Systems and Computers in Japan 
, Vol.34, Nb.]2, pp.1-10, November 2003. 

V ^^4M^^^5^t5OT/^^. mmm^intcmu^^^h. mm(D:fjr<m\amjcmiib 

[0019] ±.m<Dy'^^^'^—h-r^y^>^:ffm\^^^^X. H^ile®^a^fi^^-*3^^T. mJiet+ 

7^'t^J:oi^LXhX\^\. 
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[0020] -^^^mi^xtiii. ^mmmmi^ht^^^xmi&,mmMi^<DimL^mmm^.mii, 

[0023] ±m<Dy^l^-^^—h^y'^>'^'ijmi^i^^^X. Hijtcli3M4t^!cfcn-NX, 
[0025] [|2|l]:ijs:^P^<7)mMit^;^Sfe^£fSa5gt-smsCI2l 

[ll|3]tit;R-(7)^£Sgil5^?iOPnlg@.'^.>:^^IJ»1(7)^;§^^w<-t-1^5t^^ 
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[0026] 601 #{f8iij ^teti 

602 7^>'7°W—hpJ^BEti 

603 misi^ffn 

604 mM^ft/JMki^M^m 

605 ^toB^jifiisfe^ 

606 miMm."^ 

607 mu&mmmm. 

[0028] <^iSff^Bi> 

^mmi^mi^<oixLm^. ^Mmwwi\, j)fh<Dm.m(u. v)xm-to r.<D'M^Mmx' 
. (u, v)it.mw^m^t^t-r^o 

[0029] I'^v^ly^m-M^^'] 

T'lyzfu—hmi^t. ^mm^M^iu. v)(Dmu&=teiu. v)xm'to e{u, v){i, 

e(u, v);!5vh^V^i5^#RUiai^'Hi^(u. v)i^y':yy'i—hmm^mUL-x\^^^:Lti: 
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m^Mm (u. v)^^^^mi-s«!;a-efe^o 

[0030] iCi^Kd^-Te (u, v)it.mi&-^e (u, v) (73 J.i^0^iJ-efoSo c (u. v) 

MAD MAI) 

ean Absolute Difference) iriq^t^tbSo ^T, ^-^R}±¥-*^^i:Sfii 

[0031] ;>-;/^Vi/MSlCOt[M] 

mt\.x^^htitz.^mmm.w<^—u^^^\^x(D^. m.m.&e (u, v) ^^tmi- 

[0032] ^m(Dtcib^ ^mm^mi^iu. v) cO^M^j^acD^M/JE/j^bti/EUfrJ^^-^e 
stimatc_c(u, v)Xm-ro «Mc(u, v)^, t+^bT#e3ix;^Cr^:^t^L< filfr:/irL 
Xnhtltz'i^^=kcalc_ei\i, v)Xm-to 

[0033] M^^^^ClIf (u, v) (Dl^^^. G (1) -esfe-t c. 

n-^c (K-i)te<Dm-a-G(2). G(3). GiK)\:i'^m'r^o^<rjt^.m-<Dm 

•So 

[0034] ®fi^^.^l|-^t'Si^MG(i)(^ill/:^t::oi^T{4#^^£;^&:^^Sj'6:<)S. ^^i^jl^pi? 

m<DimB^y=f-i^^tmmiz.^m^wh<^0Mmikmi^=tm^j:^i^xmmx^ 
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[0035] m5(D{a), (b) , (c) (i. -^y^^^^^^i^tt^G (1 ) , G(2). v. G(K)(c:5>i5 
)}±. G(i)}cMi-^i:U Ifg^^tc2. 3. 4i9-<yV$tL/c#MlSi^fJi5!!c(u. v){i, G( 

2) , G (3) . G (4) iicm-t^t-r^o ^^^^»;i>^tbXV ^-v^ic^j-t-t^ili^t* 

[0036] isd5 (a) T 1 ]t^^y]^^thtz.mi^7!)mm2mmmxmm^tix^ :itb 

b(7)rijic:^LmM^*ti-^i-'5o rijirij{c:^;^(R]trj5»e*n7tr2joS£ifiU 

M^^ti/^^-2)o 1115 (b)i; ic)(DWixn. n]ty^^^^thfzmi^^''^2mmmx' 
o mmmmni. j) . 7^^^^-hx-t?s(i. j) i*. ^^;o-e)mieti6oi. 6021c: 

A;'j$tt'5o 603}i. G(l)tCja-rS-^:y^>'i5'^^ffl(u, v) (7:)i5M5£e (u, v)*r3+-#; 

#b^fc^l^^calc_e(u. v)^bTgB?tJrd1t607tc:t&^-r6o 605{i. 7^>-^L^ 
— hilij^S (i, j) i)^h^fi^\^%^^<Dm\^c\ip_thtesh (du. dv) S':^*6 
OeiC'^^a-r-So 606{i, 607[Ctelii$nfcmfJ^^calc_e(u. v)<k. mbXM^^^ti 

mate_e(u, v)^calc_e(u, v) i:LTKett607(^|&^-r5„ 603t606/jnUyjt"5 
calc_e(u, v){i. 604'iZhti:\tl^fl. 604Hcalc_e (u, v) ^^/J^jbt-^M^fi (u * 

o S7014ciDV^-t. #Ra.jli^<^^-^G(l)l:iM-t--5#M^^lsK(u. v) jr.;i^b, ® 

Me(u. v)^SrH-^U ;^;^calc_e (u, v) iSrteti-r So calc_e(u, v) l-ii^/J^jbi" 
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5(u, v)<D<^m^i5)n#i-tf9o ^sk^cs702{c*^l^-c, mu&(^Mm^^i<J^^ 

i6RIIiiScUp_thresh(du, dv)^nnU ^^^'^itl-teit-TSo S703/PbS705 
{c::foV^-C. G(l). G(2), G(K)(cM'rS(u, v)^DmMf(fe^c£trj«{'-^T 

V\ tte^*§IP:est.imate_e(u, v)^calc_e(u, v) <tLXt6ti"t"'5o IpJP#»v., calc__ 
e(u. v)^ft/Hb-t-'5(u, v)(D^tli'blR)fl§(CffV^. S706T% ;g;^lS*J{C#btifc (u 

[0039] [MMJ^tiS] 



[0042] jsiTf-. mu&m-^<D^-m^nimi^^m-t^o -^mmxi-i.. mmmimmiu. v) 

|C:Jott'5^<ei;^e(u. v)C0i1l^fitestimate_e(u. v)^, (u, v) 
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lt>i"J#-^T'fc'5o =&-^<7)I(u. v;m) im^M)^±f^'ti)tzib^^-^mmt.. {u, v) 

miiiLPO:>mB&iik^i^estimato_e (P) #fi§llf«&fJlJj!cA 1 J . A.1 2(Dm 

{tl^calc_e(All). calc_e(A12) ;6^bI(P; ^(-, calc_e(A2l) 

, calc_e(A22)75^bl(P;2)<^^i?), §:mw(P;l)<!;l(P;2)7i)^b,e(p)cDmM 

estimate_e(P)^^^-r^„ rC:r\ All. A12<l:A21. A22^Y'-/j^ib^1tzt^ . 

^(ni\Lmir^:fv\^\-i. Ail, ai2<>:A21, A22xm^^j:-^x\^^^t'<::t^M'i'^o 

[0044] ■^mmjkmi^Q(^MUf^^-^\-±.p<^^^tmmxh^o0mmmmmBii. b 

12(0®Mj5^bl(Q;l)&f+^U 2fe(-Bll, B12t8iJ(7);^fni(::'(y:fg-r5B21, 

B22<DmU&^^hl(Q;2)^s\-n-t^o I(Q; l)<[;l(Q:2);i)^ej. estimate_ 

22;5^ib. 1(R;3)^C31. C32-h^h. l(R;4)^C41, C42CD«i<J^i^;^='b4'ffilHl-r«)o 

-<Dj;9{;i5R*ofc4o(7:)MF«1{iti(R;l), i(R;2). I(R;3), \{KA)-h^h. mm 

e<]^.e*i^^itestimate_e (R) ^^^-T-So 
[0046] (u, v)(7)M{J^l^(c:^-t''5fla^<^ffir^lth^tjb<<i#T«1^iII(u, v;m){i. (u. v)*5 

yy-(>mm^j:t\ mmm^^mmi-^fMc--m\^^hrix\^^?>^-m=k^^\mir 

[0047] |2ll}±, #^|li^Mi^P<D®M^Al 1. A12. A21. A22(DWmm^hMmm 
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lis (P) i-i2^m<D^,<^.±<Dmi&.M^-^<'f-o 

[0048] Mr^mtl^X, A12, All. A21, A22d^^^RiX*fiae$H. ;5-oP7i:All<irA22 

<Dm<Dfp^icitLm.ir^m^i^.l{P:l;P)tliP:2;P)it.^^2, 3, 

o ^3^:4(^:*3v^-c(e2-el)}*. Ai2<»:Aiii0^b**:)bti6®^Jii;^(^'A)fiC'e&5o 

iZ^P--Alim(DmmtAll-A12m<DWmcOitlX2^f}^mzh(D^elfj^h^j\<Z. 

Aco^M^p. All, Ai2F^j(7>m^itiac;;DT2£M-rSo 

Ci!c2] 

I{F;l; P) = fi (calc_e(^l 1), calc__e(^l 2)) 



[^3] 

I{F;2;P) =.f^ (calc_e(^21),calc_e(^22)) 

[0049] p(cio{t-5®Mo*i^mvMr^fti^i(P;i). iiP:2)^^PiS.mx't^im^hik 

^•t-'So ^cD^^feii^^^-Cfifo^POS. '^y;t{i. I(P;l;P)il(P;2;P)CQia:;^<«max 
(P), ^/J^fi:imin(P), W-i^UlaveiP)^B^&tir^<Dt)>—^^(rj-Jym'Ch^o 
V^{i, Imax(P)iImin(P)<7>i^fl^fHlmix(P)-C:^t^fiI^^m-rS'^t^— '^^'^^^fe 
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m5] 



/„.ax (^) = max.{/(Pil)(P),/(P;2)(P)} 



me] 



^min (^) = min{/(P;l)(P),/(P;2)(P)} 



mn 



p) ^m'^mt-r^(Di,—mx'h^o McW-mti^x . ai2. ah. a2i, a22;^i^^iidps 

[i(9] 



wo 2006/075594 



13 



PCT/JP2«()6/30(II8(» 



= /2 (calc_e(^l I),calc_e(>112),calc_e(/i21),calc_e(/fl2)) 

calc _q{A\ 1) 4- calc_e(y 421) 

■'is C-^) = ' 2 



[^10] 



. . , 3ac + bd- lad - 2bc 

fi ia,b,c,d)- ; — 

a+c-o—a 



[0051] |I)8(DROj;p{C,4f@(7)ffi^ttj^I(R;l). I(R;2). I(R;3). HYi;4)^^hm 

I(R;2) (P), I(R;3) (P), I(R;4) (P)^jiSC0A#V^)li(-3fet/#X.-CIsorr. 
(R;l). Isort (R:2). Isort (R;3), Isort (R;4)<!;L, ^tbb4oO'(iS^lt 
mil- 6 1- 6 2- e 3) : 6 1: e 2: 6 3^'^M^li'CM'rf\^tclmix.{R)'::iM'f-'JjB 

[mil] 
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[0053] ClSl^ffiE^JhffloMFHlM^ttAi^)] 

v>-c. l(P;m;Q) li. P(7)i£{3^(c:{4®-r^#H^ipjm^^Q(c:*5r>«)«T^MiiS«-ro 



A Mmi^y\mi^fzj5:m<D0mmmm^tu l l q-a i i no, Amc^mi 

ml 

^Sr^F-To clip_thresh(P. A e(A ) testimaie_e{P) (Dm^AoxhmiikX' 



ml 



ml 



ml 

[i!cl2] 



Q-A 



ml 



I{P;m;Q),eiA„,) 



r{P\m\Q) = max- 



~ All 



[0055] '^^y=f-:yi^^^-&\t^^htMz.i^Wim(DmT'S^^Bm^nu^mm 

tX:<. mmWm.-&m.Qst\niatQ_e (P) ^%>fyi):^m%:t^Xi:>mU\^fc9Mm'^nh 



[^13] 
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estimate_e(P) == max {estimate_e(P), 
e(A^ 1 ) - clip_thresh(P, ^ ^ ), 

e (Aj^i)- clip Jhxesh(? Mm i)} 

[0056] rc0^to^^ii[clip_thresh (P, A) {rj^S^-fia^^ASLTti^V A'Jmm-f 
[0057] lip_thresh(P. A) li, e(A)<be(P)OM^<Dlr:^^^it^7jxbrv >5o PH^nHisJcP'^^ 

mum^m^-t^ @ P;«|S7^>:/U'-hHf^{c^fa-r'5;5^^iSi-S/cJs'j'Cifo5^' 
iij^^^JsKP^57">:7°u— hjffi^d^MbXV ^S4i-a-(^I5('9^#^e (A) ie (P) (DM 

[0058] SiMi^e (P) <7:»^a^*£5Sb. T^i^^^t^— MlftfK'^lSS6<^|WJi:ff$^^J^off:#(7^iffi^, 
«P<h®^WQP^C>-^5'9^^^^M-t-2)fi^-^aL. e(P, Q)i:-1-7,„ (fJif^: 

-e^/.^<-ct)Av^ )I2I9(C, #M^±(^^*^P> A*5J:u5'7^^:7°V"hjij^sc7:)|i)^^ 

[0059] c(P, Q)f±. ili^^mrB']cosid^t;^^^-^4;6^b. iSciti'WgQt^. 
;iWJi:ooe(s, p), e(s. A)^^^Mis:{c:^Lv^^i^#ft-r^i> 

-t^t. PAPs^cDiEE^e (P, A){*. 7'>':7'v— Kii^si7":/^i-'-hii]fts|r..-«PHl;^ 

[6] (P->A) IC-r ??bfcilj^S OP^a(DSgg|e(S. S ) -eiafi^-e -§5.., ^5*^16 

(A-P) (A-P) 

fi, e(S, T)*Se(A)<he(P)OM^O±PM^i£^a6<)fc4-^6^>:^''^t-tl^-5o . 
[icl4] 



e(5',P) + ^(P,.4)>e(5,^) 



wo 2006/075594 



PCT/JP20i)f)/30(118(l 



16 



[^15] 

e(A)-eiP)<eiP,A) 

mm 

e(A) -e{P)<eiF, A) = ^iS,T) 

„ l^^lSlCTj^-f-clip thresh2«. mM-g:<bL-C^^lic:77NL;^ce ^^ffl-^S^ 

MAD 

[^17] 

clip_threshl(P,.4) = max{0,-;io + ^eiSJ)} 



mm 
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clip_thresh 2{du^ dv) 



= max 



[0062] ^(Dj;9/i^i6tl{ittclip_thrcsh(i. MFBl::^|R]^^h/Kdu, dw) t^' 1^-/1^ ~ 
[0063] 



[0066] -4^mMmmii. #g^^S&l::S<5<7^>^»^"b-^>^^^''^if^E!''^^^-"^'"^' 

s @ -^^^^v^tc^jv >T. Els (a) <DG (1) izm^^^mm^mi^<^mmiM^sin-t 
^^^^mmw:titm-r^t. ^nmmmitc (2) . g o) . c (4) oymuiM^m-^ 
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[0067] <mmmm2> 

Htzmm^t. s2 (i. j) . w2 (i. j) xm-to Sii/h^<7)jM^ (i. j) i^Miz^-t^mmu. 



[0069] y^^^^u—hm^t^mmmM^iu, v)m<Dmu^^. mi'MMMtmmiceiu, v 

W2(i. ])-h^h%\-%-t^o ^5tl9{-*3t:t^e (2u, 2v){l, e(u, v)(r>—mXh^ 

MAD2 

mm 



1 



R. 



2 I («.y)6«2 



[0070] ^M^ft-m-r-5(u. v)t. ^iai^^ffiPMm^«(u, v)(D^>rU±. Ill5(a)(7)^< 

, v)(CoV^-C{-±, utVbf^j^T'feO, ^^19(7)eMAD2(u. v) ;5^f|-^"HrHgT?feSo G 
(2). G(3), G(4);55^-t--5(u. v)^c:oV^T^±. :i^^P^<Dit^¥^Ml-t*f oT** 
^c^M^om^^, (u. v)tc:*>Jt'5mM^e(u, v)^^/^-r^<b(C-t-So 
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[0071] iiiM^(^)ts^:J^?:fefil0b-c»,i®i£tSo^^<DMM%i^#. ml«?f^tgtl^l:' 
h(du, dv)^, m^h^ri.tzT:yy^y—mUS2{i. j)7)'^bstStbXt3J:v\ m5t20(Dc 
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